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ABSTRACT 


In  a previous  report  [2j,  the  authors  have  established  a least-element 

interpretation  to  Mangasarian1  s theory  [-5],  [6]  of  formulating  some  linear 

complementarity  problems  as  linear  programs.  In  the  present  report,  we 

extend  our  previous  analysis  to  a more  general  class  of  linear  complementarity 

li  Uri  c -£t  - ••  i 

problems  investigated  in  Mangasarian  [7].  Our  purposes  are  (l)  to 

demonstrate  how  solutions  to  these  problems  can  be  generated  from  least 

, ' V / 

elements  of  polyhedral  sets  and  investigate  how  these  "least-element 

solutions'^  are  related  to  the  solutions  obtained  by  the  linear  programming 
approach  as  proposed  by  Mangasarian. 


AMS  (MOS)  Subject  Classifications:  06A20,\l93A24,  15A45,  90C05,  90C99 

Key  Words:  Linear  complementarity,  Linear  programming,  Lattice  theory, 
Matrix  theory 

Work  Unit  Number  5 (Mathematical  Programming  and  Operations  Research) 


* 

Department  of  Operations  Research,  Stanford  University,  Stanford,  CA  9430  5. 

Mathematics  Research  Center,  University  of  Wisconsin,  610  Walnut  Street, 
Madison,  WI  53706. 


Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-7  5-C-0024, 
by  the  National  Science  Foundation  under  Grant  No.  MCS7 5-17 385. 


Ufa 


and 


A LEAST-ELEMENT  THEORY  OE  SOLVING  LINEAR  COMPLEMENTARITY 


PROBLEMS  AS  LINEAR  PROGRAMS 

5js  5}c  3}C 

Richard  W.  Cottle  and  Jong-Shi  Pang 
1.  INTRODUCTION 

In  this  paper,  we  study  the  linear  complementarity  problem  of  finding 
a vector  x * Rn  satisfying 

T 

(1.1)  x > 0,  q + Mx  > 0 and  x (q  + Mx)  = 0 

where  the  given  n -vector  q and  n X n matrix  M satisfy  the  following 

three  assumptions: 

(Ml)  MX  = Y + qcT 

(M2)  rTX  + sTY>0 

(M3)  rT(X  + C)  + sT(Y  + C)  > 0 

where  X and  Y are  suitable  Z-matrices  (i.e.  real  square  matrices 
whose  off-diagonal  entries  are  non-positive),  C is  a diagonal  matrix 
whose  diagonal  elements  are  the  components  of  the  vector  c,  and  r , 
s and  c are  some  non-negative  vectors.  We  denote  problem  (l.l)  by 
the  pair  (q,  M).  Its  feasible  set  is  defined  as  the  polyhedral  set 
X(q,  M)  = {x  e Rn  : x > 0,  q + Mx  > 0 } . 
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The  linear  complementarity  problem  (q,  M)  with  the  vector  q 
and  matrix  M satisfying  conditions  (Ml)  - (M3)  has  recently  been 
studied  by  Mangasarian  [7  | who  shows  that  such  a problem  can  be 
formulated  as  the  linear  program 

T 

i1-2)  minimize  px  subject  to  x>0  and  q + Mx  > 0 

T 

where  p = r + M‘s,  Our  purpose  in  this  report  is  to  show  that  this  result 
is  related  to  a theory  of  polyhedral  sets  having  least  elements.  (A  vector 
x belonging  to  a set  SCR  is  said  to  be  the  least  (greatest)  element 
of  S if  x < (>)  x for  every  x « S. ) The  method  of  derivation  used 
by  Mangasarian  is  not  based  on  least-element  arguments.  In  a previous 
report  [2],  the  authors  have  applied  this  theory  of  polyhedral  sets  having 
least  elements  to  the  particular  case  c = 0 and  established  that  for 
every  n-vector  q,  the  linear  complementarity  problem  (q,  M)  has  a 
solution  which  can  be  generated  from  the  least  element  of  a polyhedral  set, 
thus  providing  a least-element  interpretation  to  the  linear  programming 
formulation  of  the  problem  (q,  M)  which  was  initially  obtained  by 
Mangasarian  in  [ 5] . In  the  present  report,  we  extend  our  previous  analysis 
to  the  general  case  where  c is  merely  non-negative,  as  described  at 
the  beginning  of  the  introduction.  Our  purposes  are  (l)  to  establish  the 
least-element  characterization  of  a solution  to  the  linear  complementarity 
problem  under  consideration  and  (2)  to  demonstrate  how  this  "least-element 
solution"  is  related  to  the  solution(s)  obtained  by  the  linear  programming 
approach  as  proposed  by  Mangasarian.  Here,  we  should  point  out  that  all 
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the  linear  complementarity  problems,  which  are  listed  in  Table  1 of  [ 7 ) to  be 
solvable  as  linear  programs,  satisfy  conditions  (Ml)  - (M3).  Therefore  the 


least-element  theory  developed  in  the  present  report  is  applicable  to  all  of 

them.  However,  it  may  not  necessarily  be  applicable  to  those  problems 

satisfying  the  more  general  conditions  in  Theorem  1 of  [ 7 ) . 

It  would  be  appropriate  for  us  to  review  some  of  the  essential  results 

obtained  in  [2]  for  the  particular  case  c = 0.  Using  the  same  notations, 

we  denote  problem  (1.2)  by  the  triple  (p,q,M)  and  by  C the  class  of 

square  matrices  M for  which  there  exist  Z-matrices  X and  Y such  that 

the  following  two  conditions  are  satisfied 

(Cl)  MX  = Y 

T T 

(C2)  r X + s Y > 0 for  some  r,  s > 0 . 

These  are  precisely  conditions  (Ml)  - (M3)  with  c = 0.  The  following 
proposition  is  an  immediate  consequence  of  the  well-known  theorem  of 
Kuhn-Fourier  [ 4 ] on  the  solvability  of  a system  of  linear  relations. 

Proposition  1.1.  Let  X and  Y be  n x n matrices.  Then  the  following 
are  equivalent 

T T 

(C2)  r X + s Y > 0 for  some  r,  s > 0 

u > 0 

( C2) ' Xu  < 0 > =>  u = 0 . 

Yu  < 0 ^ 

We  have  established  useful  necessary  and  sufficient  conditions  for 
two  Z-matrices  X and  Y to  satisfy  condition  (C2).  These  are  stated  below. 
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Lemma  1-2.  Let  X and  Y be  Z-matrices  of  the  same  order.  Then  (C2) 
holds  if  and  only  if  there  exist  a principal  rearrangement  with  permutation 
matrix  P and  a partitioning  of  X and  Y such  that 

( 1 • 3a)  PTXP  = 


lx 

X 

/ Y 

Y 

11 

12 

T 

, P YP  = 

1 11 

12 

x„ 

X,„  J 

Y 

Y 

21 

22  / 

l 21 

22/ 

(1-  3b) 


lx 

x 1 

• 

11 

12 

* 

is  a K-matrix  . 

Y 

Y 

21 

22l 

for  M t C . 

Theorem  1.3.  Let  M,  X and  Y be  n x n matrices  with  X and  Y 
both  Z-matrices . Then 
(Cl)  MX  = Y 

(C2) 

if  and  only  if  there  is  a principal  rearrangement  and  partitioning  of  M,  X 
and  Y such  that 


(1.4a) 


T T 

r X + s Y > 0 for  some  r,  s > 0 


M 

M \ 

/x 

X „ \ 

/ Y Y _ \ 

1 1 

12 

11 

1 

[11  12 

M, 

M „ 

X 

X„  / ' 

1 Y,  Y 

21 

22/ 

21 

22  / 

\ 21  22 

(1.4b) 

(1.4c) 


'xn  xi2 
'Y21  Y22/ 


is  a K-matrix 


X is  nonsingular 


A K-matrix.  also  known  as  Minkowski  matrix,  is  a Z-matrix  with  a non- 
negative inverse. 


*■ 
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The  above-mentioned  least-element  result  for  the  linear  complementarity 


problem  (q,  M)  with  M t C is  stated  in  the  theorem  below. 

Theorem  1.4.  Let  M t C and  let  X and  Y be  Z-matrices  satisfying 
(Cl)  and  (C2).  Suppose  (q,  M)  is  feasible,  i.e.  X(q,  M)  # <\>.  Then 
the  polyhedral  set 

V = (v  e Rn  : Xv  > 0,  q + Yv  > 0} 

contains  a least  element  v.  Moreover,  the  vector  x = Xv  solves  the 
problem  (q,M). 

As  a consequence  to  this  theorem,  we  deduced  that  for  every  vector 
q t Rn,  the  linear  complementarity  problem  (q,  M)  with  M c C can  be 
solved  as  the  linear  program  (p,  q,  M)  where  the  vector  p is  the  (unique) 
solution  to  the  system  of  equations 

T 

p X = f 

for  some  positive  vector  f.  We  have  also  shown  that  the  vector  p 
required  in  Mangasarian's  theory  can  be  obtained  in  precisely  the  same 
way.  In  the  last  part  of  the  report,  we  established  several  related  matrix- 
theoretic  results,  and  demonstrated  that  C includes  all  the  matrices 
investigated  by  Mangasarian  in  [6]. 

We  explain  the  notations  used  in  the  paper.  All  vectors  and  matrices 
under  consideration  are  real.  A Z-matrix  X is  said  to  be  a K^-matrix 
if  (X  + el)  is  a K-matrix  for  every  e > 0.  The  letters  Z,  and  K 
will  also  denote  the  class  of  Z-,  KQ-  and  K-matrices  respectively. 
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Various  characterizations  of  K-  and  Kg-matrices  can  be  found  in  [3]. 
We  denote  the  range  space  of  a matrix  A by  9(A),  i.e.  9(A)  consists 
of  those  vectors  which  can  be  represented  as  linear  combinations  of  the 
columns  of  A.  Let  M be  an  n x n matrix.  If  I>  J — (I»  * • * > 
we  define 


where  I = {i  , . . . , i^ } and  J = {j  l , . . • , Jt>  with  1 < < • • • < ig  < n 

and  1 £ j < * • • < j < n.  In  particular,  is  a principal  submatrix 

T 

of  M.  Similarly,  if  q * Rn,  we  define  qx  = ^ , • • • , ^ ) • We  denote 

^ is 

T 

the  summation  vector  (l,...,l)  by  e. 
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2.  CONNECTION  WITH  LEAST  ELEMENTS 


2.1.  General  discussion.  Let  q be  an  n-vector  and  M an  nXn 
matrix  satisfying  conditions  (Ml)  - (M3)  for  some  Z-matrices  X and  Y, 
and  some  non-negative  vectors  r,  s and  c.  Throughout  this  section, 
these  vectors  and  matrices  are  assumed  to  possess  the  properties  just 
mentioned.  We  shall  develop  a least-element  study  of  the  linear 
complementarity  problem  (q,  M)  with  such  a vector  q and  matrix  M. 

As  a consequence  of  our  investigation,  we  shall  establish  a least-element 
interpretation  for  the  result  obtained  by  Mangasarian  [ 7 ] of  formulating 
such  a linear  complementarity  problem  as  the  linear  program  (p,q,  M)  with 
p = r + M s.  We  start  by  proving  a lemma  which  strengthens  condition  (M3). 
Lemma  2.1.  Let  c,  r and  s be  non-negative  vectors  and  let  X and 
Y be  Z-matrices.  If  condition  (M3)  holds,  then 
(M3)'  r + s > 0 . 

Proof:  It  suffices  to  show  that  for  every  i = 1,  . . . , n,  r = 0 (s.  = 0)  =>  s.  > 0 

(r.  > 0).  So  assume  r.  = 0,  say.  Then 
i i 

0 < (rT(X  + C)  + sT(Y  + C)). 

= ),  r.X,.  + V s.Y..  +s.(Y,.  + c.) 

& 1 ]1  & ] n 1 11  1 

< s,(Y, , + c.)  . 

— l n l 

Thus  s.  > 0.  Similarly,  we  may  deduce  [ s.  = 0 =>  r.  > 0 ] . Therefore 


(M3)'  follows. 
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Remark.  Condition  (M3)'  was  referred  to  as  a special  case,  but  not  as  a 

consequence  of  (M3)  in  [ 7 ] . In  fact,  if  c > 0 (as  in  Corollary  1 of  ( 7 ]), 

the  two  conditions  are  equivalent. 

We  recall  that  if  M t C,  the  matrix  X satisfying  (Cl)  and  (C2) 

must  be  nonsingular  (Theorem  1.  3).  The  following  example  illustrates 

that  there  can  be  singular  matrix  X satisfying  (Ml)  - (M3). 

Example  2.2.  Let  q = ( ^)  and  M = (j  j).  The  problem  (q,  M)  has 

two  solutions,  namely,  (^)  and  (g)-  If  X = ( g g)>  Y = (g  _i)» 

r = (°),  s = (!.)  and  c - (}),  then  conditions  (Ml)  - (M3)  are  satisfied. 

1 0 2 

Nevertheless,  X is  singular.  Moreover,  it  is  not  hard  to  verify  that  M ^C.  □ 

The  fact  that  there  exist  such  singular  matrices  X indicates  that 
in  order  to  develop  a least-element  theory  for  the  linear  complementarity 
problem  (q,  M),  one  should  not  merely  concentrate  on  the  range  space 
of  X.  In  fact,  the  same  example  above  shows  that  S?(X)  (1  X(q,  M)  = <J>. 

Later  in  our  discussion,  we  will  see  that  this  latter  relation  always  holds 
if  X is  singular  and  the  stronger  condition  (C2)  is  imposed  (see 
Proposition  2.26  and  the  remark  following  it). 

It  is  clear  that  if  M c C,  then  conditions  (Ml)  - (M3)  are  satisfied 
for  every  vector  q.  Nevertheless,  if  a matrix  M satisfies  (Ml)  - (M3) 
for  some  vector  q,  it  does  not  necessarily  follow  that  M e C.  Example  2.  2 
Illustrates  this  fact.  The  following  provides  another  example. 


Example  2.3.  Let  q - (_j)  and  M = ( * j ) . Then  conditions  (Ml)  - (M3) 
are  satisfied  with  r = (°),  s = (*),  c = (°),  X = ("J  °)  and  Y = (_J  °). 


We  show  M ^ C.  Suppose  not,  then  there  exists 


X11  "X12 
-X21  X22 


t Z such  that 


r ■) 

' X11  “X12^ 

-x  - x, 

1 1 21 

X12 

+ X22  \ 

2 -1  1 

\'X21  X22  j 

i 2x  + x 

-2x 

- X 

V / 

V 1 1 21 

12 

22  1 

€ Z 


and  (r  ,r2) 

[ Xl1  "X]i2  1 
l~X2l  X22  / 

+ (Sj,  s2) 

1 ~x 

11 

2x 

1 1 1 

"X21 
+ X21 

X21  + 
-2X12- 

X22l 
X22  1 

> 0 

for 

some  non-negative  scalars 

ri,r2’  S1 

and 

V 

It  follows 

that 

2x 

1 1 

+ x21  <0 

which  implies  x < - — x <0.  Similarly,  x + x < 0 implies 

XI  Cm  Cm  1 1 Cm  Cm  Cm 

x^  £ -x  2 — Therefore  Lemma  1 . 2 implies  that 


-x 

- x„ 

x + x_  \ 

11 

21 

12  22  ) 

2x 

+ x„ 

-2x  - x 

1 1 

21 

12  22  1 

« K 


In  particular,  det 
follows  that 


~x  - X, 

1 1 21 

X12 

2x 

+ x„ 

-2x  _ 

1 1 

21 

12 

> 0.  Since  det  M < 0,  it 


(2.  1) 

Furthermore, 


det 1 


xn 

"X12 

-x^ 

X„ 

21 

22 

= X11X22-X12X21  <0 


X11  +X12<0=>X11  <-x21^0  ' 


We  have  shown  that  x < -x  < 0;  thus  x x > x x contradicting 

Lm  Lm  1 b 1 1 UL  ^ 1 1 E 


(2.1).  Therefore  ( 2 _j)  i C. 


□ 
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The  above  examples  illustrate  that  the  present  class  of  linear 


complementarity  problems  (q,  M)  with  q and  M satisfying  (Ml)  - (M3) 
is  a genuine  extension  of  the  previous  class  of  problems  (q,  M)  with 
M t C . Example  2.  3 was  used  originally  in  [ 7 J by  Mangasarian  for 
another  purpose . 

2.2.  The  set  V . We  define 

T 

"U  - (utRn:u>0,  Xu  f 0,  Yu  < 0,  c u = l}. 

This  polyhedral  set  ty  plays  a very  important  role  throughout  our  whole 
discussion.  It  may  be  empty,  for  example,  if  c = 0 as  in  the  case  of 
M t C . The  following  example  illustrates  that  it  can  sometimes  be  non- 
empty as  well. 


Example  2.4.  Let  M 


r = 0,  X = -I  and  Y = 


0 3 4 i 

1 -1  0 and  q = 


< 0 

-1  -3 

f 2 

-1  -2 

1 -1 

1 0 

l-l 

0 2 

1 2/5 

u 

= 2/5 

' 1/5 

-2 

0 

I 


. Then  with  c = s = e, 


, conditions  (Ml)  - (M3)  are 


€ 'U.  We  shall  say  more  about  this 


example  later.  □ 

The  proposition  below  describes  the  relationship  between  vectors 
in  V (if  any)  and  solutions  to  the  linear  complementarity  problem  (q,  M). 
Proposition  2.5.  If  udi,  then  x = -Xu  is  a solution  to  (q,  M). 

Proof:  If  x = -Xu  where  inti,  then  x>  0;  moreover, 


-10- 


q + Mx  = q - MXu 

= q - (Y  + qcT)u 
= -Yu  > 0 , 

i.  e.  x € X(q,  M).  We  also  have 

T T 

0 < r x + s (q  + Mx) 

T T 

= -(r  X + s Y)u  < 0 . 

Therefore,  for  each  i = 

r.x.  = s.(q  + Mx).  = 0 . 
ill  i 

If  x.  > 0,  say,  then  r.  = 0.  Condition  (M3)'  implies  s.  > 0 which 
i l i 

gives  (q  + Mx).  = 0.  Therefore  the  vector  x defined  above  solves  the 
problem  (q,  M).  □ 

Remark  f.  In  the  proof  above,  the  assumption  that  X and  Y are  Z-matrices 
is  required  in  order  for  condition  (M3)'  to  be  applicable.  Therefore,  if 
condition  (M3)'  holds  by  itself  (as  in  Corollary  1 of  [7]),  then  the 
proposition  is  valid  for  any  matrices  X and  Y (which  are  not  necessarily 
Z-matrices)  satisfying  conditions  (Ml)  and  (M2). 

Remark  2.  The  feasibility  of  the  problem  (q,  M)  is  not  a requirement, 
but  a consequence  of  Proposition  2.5. 

Proposition  2.  5 shows  that  if  the  set  l(  is  nonempty,  then  a 
solution  to  the  linear  complementarity  problem  (q,  M)  can  be  obtained 
by  first  finding  any  vector  u in  , or  equivalently,  solving  the  system 
of  linear  inequalities 


4 


u > 0,  Xu  < 0,  Yu  < 0 and  c u = 1 

and  then  setting  x = -Xu.  The  question  of  whether  "U  is  nonempty  is 

itself  answerable  by  linear  programming.  The  next  proposition  shows 

that  if  "U  4 <f>,  then  any  vector  x such  that  x = -Xu  for  some  u i “U 

T 

actually  solves  the  linear  program  (p,q,M)  where  p = r + M s. 

Proposition  2.6.  If  u t y t then  x = -Xu  solves  the  linear  program 

T 

(p,  q,M)  with  p = r +M  s. 

Proof:  If  x t X(q,  M),  then 

T T T T 

p x = (r  + s M)x  > -s  q . 

On  the  other  hand,  the  proof  of  the  last  proposition  shows  that 

x = -Xu  « X(q,  M)  if  u t h ■ Furthermore,  with  such  an  x,  we  have 

T_  . T Tw,„_ 
p x = -(r  + s M)Xu 

, T T T T 

= -(r  X + s Y)u  - s q = -s  q . 

Therefore,  any  such  x solves  the  linear  program  (p,q,M).  □ 

Corollary  2.7.  If  M is  nondegenerate  (i.e.  every  principal  submatrix 

of  M is  nonsingular)  and  if  V * then  the  linear  program  (p,  q,  M) 

T _ _ 

with  p = r + M s has  a unique  solution  x.  Furthermore,  x = -Xu  for 

every  u t 1/  . 

Proof:  That  the  linear  program  has  a solution  x follows  from  Proposition  2.6. 
To  show  its  uniqueness,  let  x be  a solution  to  (p,q,  M).  Then  the 
proof  of  Proposition  2.  6 shows  that,  in  fact, 


T T 

r x = s (q  + Mx)  = 0 . 


If  I = {i  : r.  > 0}  and  J = n}\I,  then  x must  necessarily 

satisfy  the  following  system  of  equations 


(2.2) 


Here  we  have  used  the  fact  that  Sj  > 0 by  (M3)'.  By  the  nondegeneracy 
of  M,  the  system  (2.2)  has  a unique  solution.  This  establishes  the 
uniqueness  of  x.  The  last  conclusion  of  the  corollary  is  immediate.  □ 

Remark . The  matrix  M in  Example  2.4  is  degenerate;  nevertheless,  the 
proof  of  the  corollary  shows  that  any  solution  to  the  linear  program  (p,  q,  M) 
must  satisfy  q + Mx  = 0.  Since  M is  nonsingular,  the  LP-solution 


x 


2/5 

2/5 

1/5 


is  unique.  This  solution  was  also  obtained  in  [ 7 ] by  actually 


applying  the  simplex  method  to  the  linear  program.  Its  uniqueness  was 
not  proven  there. 

The  results  above  establish  the  relationship  between  vectors  in  %(, 
solutions  to  the  linear  complementarity  problem  (q,  M)  and  solutions  to 
the  linear  program  (p,q,  M).  In  the  sequel,  we  divide  our  discussion  into 
cases.  In  each  case,  we  shall  construct  a polyhedral  set  having  a least 
(or  greatest)  element  and  demonstrate  how  a solution  to  the  linear  comple- 
mentarity problem  can  be  generated  from  this  element.  In  the  analysis,  we 
shall  need  two  fundamental  results  from  lattice  theory.  These  are  stated 
in  Propositions  2.9  and  2.10.  Their  proofs  are  easy  and  are  omitted. 
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Definition  2.8.  Let  S be  a subset  of  Rn.  Then  S is  said  to  be  a 
meet  (join)  semi-sublattice  (of  Rn)  if  for  every  s,  t t S,  the  meet  ( join) 
of  s and  t,  defined  as  the  vector  u = (u.)  where  u.  = min(s.,t.) 
(max(s(,t.))  for  every  i,  belongs  to  S.  The  set  S is  bounded  below 
(above)  if  there  exists  a vector  s t R such  that  s > (<)  s for  every 
s f S. 

Proposition  2.9.  The  following  are  equivalent: 

1)  L is  a polyhedral  meet  (join)  semi-sublattice  of  Rn. 

2)  L - {s  ( R°  : As  >b}  for  some  matrix  A and  vector  b,  with  A 
having  at  most  one  positive  (negative)  element  in  each  row. 

Proposition  2.10.  Let  L be  a nonempty  meet  (join)  semi-sublattice  of  Rn. 
If  L is  closed  and  bounded  below  (above),  then  L has  a least  (greatest) 
element.  Furthermore,  this  element  can  be  obtained  by  solving 

T 

(2.  3)  minimize  (maximize)  f x subject  to  x « L 

for  any  positive  vector  f. 

We  should  also  mention  that  a least  (greatest)  element  of  a meet  (join) 
semi-sublattice  L of  Rn  actually  solves  the  program  (2.3)  for  any  non- 
negative vector  f and  it  is  the  unique  solution  if  f is  positive. 

In  the  theorem  below,  we  describe  a polyhedral  set  with  a least 
element  and  show  how  this  element  can  easily  generate  a solution  to  the 
problem  (q,  M)  in  the  case  * 4>* 
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Theorem  2.11.  Define 


3 = Pi  {u  € Rn  : u < 0,  Xu  > 0,  Yu  > 0,  c.u.  > -1  } 

- - > - i i 

1=1 


T- 


Then  3 has  a least  element  u.  Furthermore,  if  * <j>,  then  c u < -1 


and  the  vector  x = - 


T- 
c u / 


solves  the  linear  complementarity  problem  (q,  M). 


Proof:  Proposition  2.9  implies  that  3 is  a meet  semi- sublattice  of  R . 
It  is  obviously  closed  and  nonempty  because  o t S'.  We  show  that  3 
is  bounded  below.  Let  u € S',  clearly  u.  > -l/c.  for  every  i e I 
where  I = {i  : c.  >0}.  Furthermore,  letting  J = {i  : c.  = 0),  we  have, 


(2.4a) 


XJJUJ  - “XJIUI  - ~XJIdI 


and 

(2.4b) 


YJJUJ  - “YJIUI  ~ ~YJIdI 


where  d = (d.)  is  the  vector  with  d,  = -l/c.  for  i « I and  o other- 
i ii 

wise.  On  the  other  hand,  it  follows  from  condition  (M3)  that 

rlxjj  + h vj,  * -<r\  + *r V ^ 0 • 


i.e.  the  Z-matrices  X and  Y satisfy  condition  (C2).  Therefore  by 


Lemma  1.2,  the  matrix 


JJ 

'n 


contains  a complementary  submatrix  which 


is  Minkowski, 
implies  that  u^ 
bounded  below. 


This  fact,  together  with  inequalities  (2.4a)  and  (2.4b) 
is  bounded  below  by  some  constant  vector.  Hence  3 is 
Therefore  it  has  a least  element  u by  Proposition  2.  10. 
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Clearly  -u  € J If  u < • Thus,  u < -u  for  every  u t l/.  Hence 

T—  T 

C11<-1  if  v * <t»-  It  is  then  clear  that  «l(,  Therefore  the  last 

c u 

assertaion  of  the  theorem  is  an  immediate  consequence  of  Proposition  l.  5. 
Remark.  The  assumption  Z(  * 4*  is  essential  in  order  for  the  vector  x 
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W — — — — ™ - — — — 

Combining  Theorem  2.11  with  Corollary  2.7,  we  conclude  that  if 

M is  nondegenerate  and  if  * <j>>  then  the  (unique)  solution  to  the 

linear  program  (p,  q,  M)  is  given  by  the  vector  x = -X  where  u 

c u 

is  the  least  element  of  3.  This  result  provides  a least-element  interpreta- 


tion to  the  solution  of  the  linear  program  introduced  by  Mangasarian. 

2.3.  The  case  where  "U  = 4>  and  X is  nonsingular.  Having  completed 

our  discussion  of  the  case  1/  4 <f>,  we  proceed  to  investigate  the  case 

"K  = < |>.  We  establish  the  following  important  lemma. 

Lemma  2.13.  If  = <t>,  then  the  following  implication  holds 

*\ 

u > 0 

(2.5)  Xu  < 0 ) =>  u = 0 . 

Yu  < 0 ^ 

Proof:  Suppose  there  exists  a nonzero  vector  u such  that  u > 0,  Xu  < 0 

T 

and  Yu  < 0.  Then  we  must  have  c u = 0 because  otherwise  — t l( 

c u 

contradicting  the  assumption.  Thus,  Cu  = 0.  Hence, 

0 < [rT(X  + C)  + sT(Y  + C) ) u 
T T 

< (r  + s )Cu  = 0 

which  is  a contradiction.  □ 

j 

In  fact,  the  converse  of  Lemma  2.  13  holds,  namely,  if  (2.  5)  holds, 
then  "U  = 4>-  Now,  by  Proposition  1.1,  condition  (2.5)  is  an  equivalent 
formulation  of  condition  (C2).  Therefore,  adding  the  assumption  "U  = <t> 
to  (Ml)  - (M3)  is  actually  equivalent  to  replacing  conditions  (M2)  and  (M3) 
by  the  single  stronger  condition  (C2). 
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Corollary  2.14.  Let  1(  - 4>.  Then 


T 

u i 0,  Xu  = 0 =>  c u * 0 . 

Proof:  Indeed,  if  there  exists  a nonzero  vector  u such  that  Xu  = 0 
T 

and  c u = 0.  Then  it  follows  from  (Ml)  that  Yu  = 0.  But  this  is 
impossible  because  by  Lemma  2.13  above  and  Lemma  1.2,  the  matrix  ( 
contains  a nonsingular  complementary  submatrix;  this  latter  fact  implies 
u = 0,  contradicting  the  assumption.  □ 

We  have  given  an  example  earlier  illustrating  that  there  can  be 
singular  matrix  X satisfying  conditions  (Ml)  - (M3).  The  proposition 
below  shows  that  if  = 4>,  such  matrices  have  rank  at  least  n - 1. 
Proposition  2.15.  If  V = <P,  then  rank(X)>n-l. 

Proof:  Suppose  rank(X)<n-l.  Let  u1  and  u2  be  two  linearly 
independent  vectors  such  that  Xu1  = Xu2  = 0 and  c^u1  = cTu2  = 1. 

The  existence  of  these  vectors  follows  from  the  assumption  and  Corollary  2.  14. 
We  then  have 


x > 


is  also  possible  even  if  V - 4>-  Later  in  our  discussion,  we  shall  provide 


necessary  and  sufficient  conditions  for  X to  be  nonsingular  (see  Theorem  2.22). 
Example  2.16.  Let  q = ( <j>)  and  M = ( ^ j).  The  problem  (q,  M)  has 

a solution  (<j>).  Now  let  X = (*  g),  Y = (°  <j>),  c = e,  r = (*)  and 
s = (<j>).  Then  MX  - Y + qc^  and  r^X  + s^Y  > 0.  Therefore  V - <j>. 
Nevertheless,  X is  of  rank  1.  □ 

In  the  sequel,  we  shall  first  establish  the  least-element  results 
for  the  case  where  X is  nonsingular.  Then  we  shall  prove  two  characteriza- 
tion theorems  having  to  do  with  the  nonsinguiarity  of  X.  Finally,  we 
shall  investigate  the  last  case,  namely,  where  X has  rank  n - 1. 

If  X is  nonsingular,  then  the  linear  complementarity  problem  (q,  M) 
is  equivalent  to  the  following  complementarity  problem  (LECP^): 

q(  1 + cTu)  + Yu  > 0,  Xu  > 0 and  [ q(  1 + c^u)  + Yu  ] ^Xu  = 0 . 

The  equivalence  is  based  on  the  transformation  x = Xu.  It  is  clear  that 
x is  a (feasible)  solution  to  the  problem  (q,  M)  if  and  only  if  u = X Jx 
is  a (feasible)  solution  to  the  problem  (LECP^).  Let  3^  denote  the 
feasible  set  of  the  latter  problem,  i.e. 

n T 

3^  = (u  t R : q(l  + c u)  + Yu  > 0,  Xu  > 0 } . 

T 

Proposition  2.17.  If  %t  = <f>,  then  1 + c u 4 0 for  every  u « 3 . 

T 

Proof:  Suppose  there  is  a u « 3^  such  that  l + c u = 0.  Then  it  follows 

X 

that  Yu  >0,  Xu  > 0.  Since  the  matrix  (^)  contains  a Minkowski  comple- 
mentary submatrix,  we  must  have  u > 0 contradicting  the  assumption  that 
T 

1 + c u = 0.  □ 
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By  the  convexity  of  3^  it  follows  that  one  and  only  one  of  the 
following  two  statements  must  hold: 


(2.6a) 


1 + c u > 0 for  every  u * 3 


(2.6b) 


1 + c u < 0 for  every  u ( 3(  . 


Lemma  2.  18.  Let  V - <t>  and  3^  * 4>-  Suppose  (2.  6a)  ((2.  6b))  holds.  Let 

= { v « Rn  : q + Yv  > (<)  0,  Xv  > (<)  0 } . 

— T 

Then  has  a least  (greatest)  element  v satisfying  c v < ( >)  1 . 

T 

Furthermore,  (q  + Yv)  (Xv)  = 0. 

Proof:  Proposition  2.9  implies  that  is  a meet  (join)  semi-sublattice 

of  Rn.  It  is  obviously  closed.  The  fact  that  (^)  contains  a Minkowski 

complementary  submatrix  implies  that  is  bounded  below  (above).  We 

T 

show  that  it  is  nonempty.  Let  u e 3j  satisfy  1 + c u > (<)  0,  then 
it  is  not  hard  to  see  that  the  vector 


(2.7) 


T 

1 + c u 


belongs  to  . By  Proposition  2.  10,  has  a least  (greatest)  element  v. 

T_  — T 

That  v satisfies  c v < (>)  1 is  clear  because  v < (>)  v and  c v < (>)  1 

where  v is  the  vector  defined  in  (2.7).  To  show  that  v satisfies  the 

complementarity  property,  we  refer  the  reader  to  the  proof  of  Lemma  3.  10 

in  [2].  □ 

Remark.  The  polyhedral  set  A does  not  depend  on  the  vector  c.  If 

(2.6a)  holds,  this  set  A is  precisely  the  set  V mentioned  in  the  introduction. 
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The  following  result  generalizes  Theorem  1.4  pertaining  to  the 


problem  (q,  M)  with  M e C which  corresponds  to  the  case  c = 0. 
Theorem  2 . 1 9 . Let  = <J>.  Suppose  X is  nonsingular  and  the  problem 
(q,  M)  is  feasible.  Then  the  vector 


(2.8) 


V 1 - c V / 

where  v is  the  vector  obtained  in  Lemma  2.  18,  i 
linear  complementarity  problem  (q,M). 

Proof:  In  fact,  if  x e X(q,  M),  then  u = X *x  ! 

— v 

vector  v is  well-defined  and  so  is  u = — 


s a solution  to  the 


3 . Therefore  the 
. It  is  easy  to  show 


1 - c v 

that  u solves  the  problem  (LECP^).  Therefore  by  the  equivalence  of 
the  problems  (q,  M)  and  (LECP  ) mentioned  earlier,  it  follows  that  the 
vector  x defined  in  (2.8)  solves  the  problem  (q,M).  □ 

Theorem  2.19  shows  how,  under  the  assumptions  in  the  theorem,  a 
solution  to  the  linear  complementarity  problem  (q,  M)  can  be  generated 
from  the  least  (or  greatest)  element  of  the  polyhedral  set  . One 
notices  that  in  some  instances,  the  linear  complementarity  problem  has  a 
solution  generated  from  the  greatest  element  of  a polyhedral  set.  This 
may  seem,  at  first  glance,  somewhat  inconsistent  with  the  title  "A  least- 
element  theory  ..."  of  the  report  and  with  the  phrases  "least-element 
solutions",  "least-element  characterization",  etc.  ...  which  have  been 
used  throughout  the  report.  However,  it  is  not  hard  to  see  that  such 
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greatest-element  results  can  always  be  changed  into  least-element  results 


by  a very  trivial  modification,  namely,  by  considering  the  negative  of 

the  polyhedral  sets  having  the  greatest  elements.  We  have  not  made  this 

change  of  variables  in  Lemma  2.18,  and  will  not  do  so  later  because  we 

want  to  present  the  results  in  their  most  natural  format. 

In  the  sequel,  we  establish  a relationship  between  the  vector  x 

generated  in  Theorem  2.  19  and  the  solution(s)  to  the  linear  program 

T - 

(p,q,M)  with  p = r + M s.  Specifically,  we  show  that  x solves  any 
such  linear  program;  moreover,  it  is  the  unique  solution  if  the  vectors  r 
and  s satisfy  the  stronger  condition  (C2). 

If  X is  nonsingular,  then  under  the  nonsingular  transformation, 
x = Xu,  the  linear  program  (p,q,  M)  is  equivalent  to 


(2.9)  minimize  (p  X)u  subject  to  q + MXu  > 0 and  Xu  > 0 . 

Noting  that 

T*  rp  rp  rp  rp  rp  rp 

p X = (r  + s M)X  = (r  X + s Y)  + (s  q)c 


we  may  write  (2.9)  as 

T T T T 

(2.  10)  minimize  (r  X + s Y)u  + s q(l  + c u)  subject  to  u < 5^  . 

In  order  to  simplify  the  following  discussion,  we  assume  that  (2.  6a) 
holds.  Since  v is  the  least  element  of  j>  , it  solves  the  linear  program 


(2.11) 


minimize 


,T 
f v 


subject  to  v « J« 


1 


for  any  nonnegative  vector  f,  and  it  is  the  unique  solution  to  (2.  1 1 ) for 
any  positive  vector  f.  It  is  then  easy  to  deduce  that  the  vector 
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u = ~ (or  equivalently,  v = 

1 - c v 


T- 

1 + c u 


solves  the  (fractional)  program: 


(2.  13) 


minimize  ~ subject  to  u t 3 

1 + c u 1 


for  any  nonnegative  vector  f,  and  it  is  the  unique  solution  to  (2.  13)  for 
any  positive  vector  l. 

Theorem  2.20.  Let  = 4>.  Suppose  X is  nonsingular  and  (q,  M)  is 

feasible.  Then  the  vector  x (defined  in  (2.8))  solves  the  linear  program 

T 

(p,  q,  M)  with  p = r + M s.  Moreover,  it  is  the  unique  solution  to  any 

T T 

such  linear  program  with  r X + s Y > 0. 

Remark.  This  theorem  is  valid  no  matter  which  one  of  the  two  inequalities 
(2.  6a)  and  (2.6b)  is  valid.  To  simplify  the  proof  below,  we  continue  to 
assume  (2.6a)  holds. 

Proof  of  the  theorem:  It  suffices  to  show  that  the  vector  u (defined  in 

(2.  12))  solves  (2.10)  and  u is  the  unique  solution  to  (2.  10)  if 

rTX  + s^Y  > 0.  Let  u £ 3 , then  U T . Thus 

1 + c u 


T T u T T 

(r  X + s Y) < (r  X + s Y) 

1 + c u 


T 

1 + c u 


which  implies 


(2.  14)  (rTX  + sTY)u  + sTq(l  + CTu)  < [ (rTX  + STY)u  + STq(l  + cTu)] 


T.  T_ 

T . , 1 + c u 


T 

1 + c u 
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Furthermore,  we  have 


- u u 

v = z < 


T-  - T 

1 + c u 1 + c u 


Hence, 


T_ 

1 + c u 

T ~ 
1 + c u 


1 . 


On  the  other  hand. 


(rTX  + sTY)  u + sTq(  1 + cTu)  = rT(Xu)  + sT(q  + (Y  + qcT)u)  > 0 . 
Therefore,  for  u t 3 

(rTX  + sTY)u  + sTq(l  + cTIT)  < (rTX  + STY)u  + sTq(l  + CTu) 
i.  e . u solves  (2 . 10) . 

Conversely,  if  u solves  (2.10),  then  (2.14)  must  hold  as  equality. 
Therefore,  we  have 


(rTX  + sTY)  = (rTX  + STY)  


T- 

1 + c u 


T 

1 + c u 


T T 

i.e.  u also  solves  (2.  13).  Now  if  r X + s Y > 0,  it  follows  from  the 


uniqueness  of  u that  u = u.  □ 

Example  2.21.  Let  q = ( j)  and  M = ( ^ * ) • The  problem  (q,  M) 

solutions  (*)  and  (°).  If  X = ( * °),  Y = Lj  4^  r = s = 0 

0 T T T 

and  c = (^),  then  MX  = Y + qc  and  rX+sY>0.  It  is  not  hard  to 

show  that  M ( C . 


has 
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1 


X + x„ 


1 


Fig.  2.  V = <j>  and  X nonsinguiar. 


v 

1 

* 


= 0 


- v.  + 4v 


Before  proceeding  to  study  the  case  rank(X)  = n - 1,  we  prove 
two  theorems.  The  first  of  which  characterizes  the  nonsingularity  of  X; 
whereas  the  second  provides  necessary  and  sufficient  conditions  for 
(2.6a)  and  (2.6b)  to  hold.  As  a consequence  of  the  theorems,  we  deduce 
that  the  assumptions  in  Lemma  2.  18  and  Theorem  2.  19  are  actually 
equivalent. 

Theorem  2.22.  The  following  two  conditions  (2.15)  and  (2.  16)  are  equivalent: 
12.15)  X is  nonsingular 

(2.  16)  there  exist  a principal  rearrangement,  with  permutation  matrix  P, 


and  partitioning  of  X,  Y,  q and  c such  that 


T i 

[\l 

X12^ 

T 

fYn 

(2.1 6a) 

P XP  = 1 

lX2, 

X22i 

, P YP  = 1 

ly2, 

Y22  ) 

(2.16b) 


/M  (c  1 

P V , PTc  * 

\ 2 C2 


(2.1  6c) 


X and  (Y  - Y X X ) are  nonsingular 

11  Cm  C.  C.  1 1 i 1 C. 


(2.1 6d) 


1 + (cl  - cTX_1X  J(Y„  - Y X_1X  )~ 1 q * 0 
v 2 1 11  12n  22  21  11  12'  m2 


Proof:  That  (2.  15)  implies  (2.  16)  is  trivial.  For  the  converse,  it  suffices 
(see  [ 1 ])  to  show  that  the  matrix  X - X X jx  is  nonsingular.  We  ha\ 

Cm  Cm  Cm  i 11  L Cm 

'MU  M12\/Xll  X12\  (hi  Y12\ 

1M2,  M22AX21  X22'  = '21  ^MvT' 


T P 
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Solving  for  M^  ^ in 


MX  + MX,  = Y,  + q,c 
21  11  22  21  21  HZ  1 


gives 


M,  = ( Y - MX,  )X_1  + q cTX_1  . 

21  v 21  22  2 1 7 11  m2  1 11 


Substituting  this  latter  equality  in 


MX  +MX  = Y + q c 
21  12  22  22  22  42  2 


yields 


M22(X22  - X21XHX,2»  = (Y22  - Y2,XnV  + "2(cI  - 'frlV 
= ,V22  - Y2.XU  V11  * ,Y22  - Y2,XnX,2>'VI  ' CX!X,2»  ' 

Condition  (2.  l6d)  implies 

detl,t(Y22-Y2,XnX,2»'1<I2(C2-<XUX,2)l 

= 1 +<^cK;X12)<Y22-Y21XnX,2>'52'0- 

This  establishes  the  nonsingularity  of  X - X X jx  . 

Remark.  The  argument  used  above  is  a generalization  of  the  one  in 

Theorem  1 . 3 for  the  case  M e C . In  the  proof,  we  have  used  the 

condition  (Ml)  only.  So  in  fact,  the  theorem  provides  necessary  and 

sufficient  conditions  for  the  matrix  X (not  necessarily  Z-matrix)  satisfying 
T 

MX  = Y + qc  for  some  matrices  M and  Y (not  necessarily  Z-matrix) 
and  some  vectors  q and  c (not  necessarily  non-negative),  to  be 
nonsingular. 
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Theorem  2.2  3.  Let  V = <f-  Suppose  3^4).  Then  (2.  6a)  ((2. 6b))  holds 
if  and  only  if  there  exist  a principal  rearrangement  with  permutation  matrix 
P,  and  partitioning  of  X,  Y,  q and  c such  that 


(2.  17a) 


X X 
11  12 

X„  X„ 
21  22 


T 

P YP  = 


Y Y 

11  12 

Y Y 

21  22 


(2. 17b) 


T 

P c = 


(2.17c) 


X X „ 

11  12 

Y Y 

21  22 


(2. 1 7d) 


1 t(^CX!X12><Y22- 


Proof:  ' Sufficiency".  Let  u t 3 . Then  we  have 


Condition  (2.  17c)  implies  that 


11 

12 

21 

Y22 

X 

J"1 

11  12 

Y Y 
21  22 


> 0;  thus 


(2.18) 


xn  M 0 

V2!  Y2 zl  W 


(1  + c u)  + u > 0 . 


Let  t = | satisfy 


xn  xu\[ti 

Y2,  YJW 
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Therefore  1 +c  u>(<)0  for  every  u « 3 i.e.  (2.6a)  ((2.  6b))  holds . 

"Necessity".  The  existence  of  the  permutation  and  partitioning  such  that 

conditions  (2.  17a)  - (2.  ]7c)  are  satisfied  is  an  immediate  consequence 

of  the  assumption  % = 4>  and  Lemma  1.2.  So  it  remains  to  verify  (2.  17d). 

The  deduction  above  shows  that  (2.20)  is  valid  for  every  u « 3^.  Now 

if  5^  * and  (2.6a)  ((2.6b))  holds,  then  it  follows  from  (2.20)  that 
T 

1 + c t > (<)  0,  or  equivalently,  (2.  I7d)  holds.  □ 

We  have  seen  that  if  X is  nonsingular  and  if  the  problem  (q,  M) 
is  feasible,  then  3 * 4>.  Combining  Theorems  2.22  and  2.23,  we 

conclude  that  if  K = 4>  and  if  3^  * <j>  then  (q,  M)  is  feasible  (in  fact, 
has  a solution)  and  X must  be  nonsingular. 
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Corollary  2.2 4.  If  1(  = <f>,  the  following  are  equivalent 

( 2 . 2 1 ) X is  nonsingular  and  (q,  M)  has  a solution  (given  by  (2.  8)) 

(2.22)  3^*4). 

2.  4.  The  case  where  fy  = <t>  and  X is  singular.  In  the  rest  of  this 

paper,  we  investigate  the  remaining  case,  namely  V.  = 4>  and  rank  (X) 

= n - 1 . Let  u°  be  the  (unique)  vector  satisfying 

0 TO 

Xu  =0  and  c u = 1 . 

The  existence  of  such  a vector  follows  from  Corollary  2.  14.  Then,  it 
follows  that 

(2.23)  q = -Yu°  . 

1 T l 

Let  u be  a nonzero  vector  satisfying  Xu  =0.  It  follows  from 

elementary  linear  algebra  that,  for  any  x « Rn,  there  exist  u « Rn 

and  a c R1  such  that 

(2.24)  x = Xu  + au*  . 

Under  such  a representation,  we  have,  by  (2.23) 

q + Mx  = q + MXu  + aMu* 

T 1 

= q(l  + c u)  + Yu  + aMu 

TO  1 

= Y[  u - (1  + c u)u  ] + aMu  . 

Proposition  2.25.  Under  the  identification  (2. 24),  the  linear  complementarity 
problem  (q,  M)  is  equivalent  to  the  problem  (LECP^)  of  finding  a vector 
u « Rn  and  a scalar  a such  that 
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aMu*  + Y[  u - (1  + c^u)u°]  > 0 
au*  + X[  u - (1  + cTu)u°]  > 0 

[ aMu*  + Y(u  - (1  + cWt  au*  + X(u  - (1  + cTu)u°)  ] = 0 . 

Let  3^  denote  the  feasible  set  of  (LECP^),  i.e. 

3^  = {(^)  ‘ Rn+*  : a Mu*  + Y(u  - (1  + c^u)u°)  > 0,  au*  +X(u  - (1  + c^u)u°)  > 0 } . 

Proposition  2.26.  If  l<  = <p,  then  a * 0 for  every  (U)  e 3 . 

a c 

Proof:  Suppose  there  exists  (U)  e 3_  such  that  a = 0.  Then 

a 2 

Y[  u - (1  + c^u)u°  J > 0 
X[  u - (1  + c^u)u°]  > 0 . 

T 0 

Hence,  by  Lemma  1.2,  it  follows  that  u - (1  + c u)u  >0.  Thus 

0 < c^[  u - (1  + cTu)u°  ] = -1 
which  is  a contradiction.  □ 

Remark.  An  equivalent  formulation  of  the  conclusion  in  Proposition  2.26 
can  be  stated  as  X(q,  M)  fl  f?,(X)  = 4>. 

By  the  convexity  of  3^,  it  follows  that  one  and  only  one  of  the 
following  two  statements  must  hold: 

(2.  25a)  a > 0 for  every  (U)  £ 3_ 

a 2 

(2.  25b)  a < 0 for  every  (U)  £ 3_  . 

a Z 

Lemma  2.  27.  Let  V = <t>  and  3^  # 4>.  Suppose  (2.  25a)  ((2.  25b))  holds. 
Define 

= {v  £ Rn  : Mu*  + Yv  > (<)  0,  u*  + Xv  > (<)  0}  . 
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1 


Then  has  a least  (greatest)  element  v satisfying  c v < (>)0. 

1 T 1 

Furthermore,  (Mu  + Yv)  (u  + Xv)  = 0. 

1 TO  T 1 

Proof:  If  (U)  < 3.,  then  v = 7(u  - (1  + c u)u  ) t and  c v = - 
a c a £ 

The  rest  of  proof  proceeds  in  the  same  way  as  in  the  proof  of  Lemma  2.18.  □ 

Theorem  2.28.  Let  tu  - <P-  Suppose  rank(X)  = n - 1 and  the  problem 
(q,  M)  is  feasible.  Then  the  vector 

(2.  26)  x = - “ (Xv  + u1) 

c v 

where  v is  the  vector  obtained  in  Lemma  2.27,  is  a solution  to  the  linear 
complementarity  problem  (q,M). 

Proof:  The  assumptions  in  Lemma  2.27  are  satisfied.  Therefore,  x is 

well-defined.  It  suffices  to  show  that  u = - ~r  and  a = - T_  solves 

T_  c v c v 

the  problem  (LECP^.  Noting  that  1 + c u = 0,  we  can  easily  deduce 

that  (-)  indeed  solves  ( LECP  ) . This  establishes  the  theorem. 
a £ 

Having  demonstrated  how,  under  the  assumptions  of  Theorem  2.28, 

a solution  to  the  linear  complementarity  problem  can  be  generated  from  the 

least  (or  greatest)  element  of  the  polyhedral  set  we  next  establish 

a relationship  between  this  solution  x and  the  solution(s)  to  the 

T 

linear  program  (p,  q,  M)  with  p = r + M s. 

Theorem  2.29.  Let  V.  = <P-  Suppose  rank  (X)  = n - 1 and  (q , M)  is 

feasible.  Then  the  vector  x (defined  in  (2. 26))  solves  the  linear  program 

(p,  q,  M)  with  p = r + MTs.  Moreover  it  is  the  unique  solution  to  any 

T T 

such  linear  program  with  r X + s Y > 0. 
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Proof:  Assume  for  simplicity,  that  (2.25a)  holds.  The  argument  which 

follows  is  similar  to  that  of  Theorem  2.20.  Let  x = Xu  + »u*  « X(q,  M), 
1 TO 

then  v = — (u  - (1  + c u)u  ) t Jr  . Hence  we  have 
a 2 

— 1 TO 

v < — (u  - (1  + c u)u  ) 
a 


which  implies 


T—  ^ 1 

c v < - . 

a 


Moreover,  by  (2.23), 
(2.27) 


T T — 1 T T TO 

(r  X + s Y)v  < ~(r  X + s Y)(u  - (1  + c u)u  ) 
a 


Furthermore, 


= ~[(rTX  + sTY)u  ■+  sTq(l  + cTu)]  . 
a 


r^(Xu  + ttU^)  + s^[q  + M(Xu  + cru*)]  >0  . 


Combining  the  above  inequalities,  we  deduce, 
pTx  = (rT  + sTM)(-  -^(Xv  + u1)) 

C V 

ITT  T T T T 1 

= - -^-[(r  X + s Y)v  + s ~q(c  v)  + (r  + s M)u  ] 

c v 

11TT  TT1T  T T 

< - — ^ — [ ^ { ( r X + s Y)u  + a(r  + s M)u  + s q(l  + c u) } ] - s q 

c V 

= (-  —“)(“)[  rT(Xu  + au*)  + sT(q  + M(Xu  + au*))]  - sTq 

1—  or 
C V 

T T T 

< (r  + s M)x  = p x . 


Therefore  x solves  the  linear  program  (p,q,  M). 
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Conversely,  if  x is  a solution  to  (p,  q,M),  then  we  must  have 

T T — 

equality  in  (2.27).  If  r X + s Y > 0,  then  by  the  uniqueness  of  v,  it 


— 1 TO, 

follows  that  v = — (u  - (1  + c u)u  ).  Thus  a 
a 


-y-  and  Xu  = - yr  Xv. 

C V C V 


Therefore,  x = Xu  + au  = - y~(Xv  + u ) = x.  This  establishes  the 

c v 

theorem.  □ 

We  conclude  this  paper  by  proving  a result  (Corollary  2.  31)  which 

strengthens  Corollary  4 of  Mangasarian's  report  [7]  where  it  was  shown 

that  if  n > 3 and  M is  a positive  matrix  which  is  diagonally  dominant 

column-by-column,  that  is,  m. . > Y m j = 1,  . . . ,n,  then  conditions 

JJ  ~ i*j  U 

(Ml)  - (M3)  are  satisfied  (in  fact  for  every  n-vector  q). 

Proposition  2.30.  Let  M be  an  n X n matrix  satisfying 


(2. 28a) 


MX  = Y for  some  X,  Y e Z 


(2. 28b) 


r X > 0 for  some  r > 0 


(2.  28c) 


Y = (Y_)  is  such  that  Y < 0 for  every  j # i 


Then  M « C. 

Proof:  Let  e > 0 be  small  enough  such  that  Y + eM  « Z.  Then 
M(X  + el)  = Y + eM  and  X + el  * K.  Therefore  M t C.  □ 

Corollary  2.  31.  Let  n > 3 and  let  M be  a positive  n x n matrix 
which  satisfies  either  of  the  following  conditions: 

(2.29a)  diagonal  dominance  column-by-column:  m..>  ^,m..,  j = 1,  . . . , n 

J)  i*j  1J 

(2.29b)  diagonal  dominance  row-by-row:  m > ^ m..,  i = 1,  . . . , n . 

11  j*i  l) 

Then  M t C. 
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Proof:  We  may  without  loss  of  generality,  assume  that  M has  been 

normalized  so  that  it  has  ones  on  the  diagonal.  Let  M = 1+  F where 

P = (F.j),  F..  = 0 and  F = m..  for  1 # j.  Define  X = I - F and 
2 

Y - MX  = I - F . Clearly  X and  Y < Z.  Furthermore,  it  is  easy  to 
see  that  condition  (2.  28c)  is  satisfied.  We  show  that  (2.  28b)  is  also 
satisfied.  It  is  clearly  satisfied  if  (2.29a)  holds.  Now,  if  (2.29b)  is  true, 
then  X c Kq  (by  Theorem  (5.4)  in  [ 3])  and  X is  irreducible  (see  [8]). 
These  two  properties  of  X imply  (2.28b)  (by  Theorem  (5.8)  in  [ 3]). 
Consequently,  by  Proposition  2.30,  M t C.  □ 
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